Al AA-94-1 289-CP 


ALL FEASIBLE PLANS USING TEMPORAL REASONING 

Debasis Mitra* Rasiah Loganantharaj t 

{dm, logan}@cacs. usl.edu 
Automated Reasoning Lab 
Center for Advanced Computer Studies 
University of Southwestern Louisiana 
P.O. Box 44330 
Lafayette, L.A. 70504 


Abstract 

In this paper we have discussed some of the 
issues involved in planning utilizing a temporal 
reasoning system. One of the advantages is that 
of being able to handle incomplete information. 
In these circumstances, there may be multiple 
plans available for achieving a task. Using an 
algorithm, designed recently by us, generating 
all feasible plans may be practicable in most 
of the instances, although the problem is NP- 
complete. The significance of having all feasible 
plans in a plan data base is quite important. We 
have also discussed these issues here. 

I. Introduction 

Temporal reasoning is becoming an impor- 
tant tool for planning[4, 5, 11]. Although it 
is not very easy to represent planning problem 
as a temporal reasoning problem, the advan- 
tage of doing so is immense. In this paper we 
have discussed one of such advantages. Tem- 
poral reasoning allows one to represent incom- 
plete information between operations and other 
primitives in a planning problem. This is a step 
forward from blocks world problem towards re- 
alistic planning. Under such uncertainty, there 
may be more than one plan which is feasible. 
Using an algorithm devised by us[8], all such 
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feasible plans can be found out. The signifi- 
cance of the availability of such a complete plan 
data base is discussed in this article. 

Interval based temporal reasoning scheme 
gives planning activity the advantage of having 
some parallely executable operations. In this 
paper we have used this interval-based tempo- 
ral representation scheme. The price of having 
higher expressiveness in interval-based scheme 
is that the problem of handling incomplete in- 
formation is NP-complete. Our algorithm is an 
efficient one, and under most of the circum- 
stances it should be able to handle the prob- 
lem in acceptable time, although the worst case 
growth rate remains exponential. 

II. Planning and Temporal Reasoning 

Planning is the task of choosing a subset 
from a given finite set of operations and order- 
ing them in time. Each operation has a set 
of precondition and postcondition states of the 
world. Preconditions are states required for an 
operation to become executable, and postcondi- 
tions are states created by its execution. Given 
a set of start conditions and a set of goal con- 
ditions, the problem of planning is to see that 
chosen sequence of operations change the states 
of the world from start conditions to goal con- 
ditions. This perspective of planning is akin to 
a state change-based point of view in tempo- 
ral reasoning, as in situation calculus. A dif- 
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ferent approach had been taken by Allen et 
al[2] about planning where they have tried to 
formalize planning with more explicit temporal 
reasoning. According to the conventional view, 
temporal identities, both operations and states 
of the world (or fluents ), are related to each 
other in such a way that the end of one is the 
starting point of the other. In interval based 
temporal reasoning scheme this latter temporal 
relation is the ‘meet’ primitive[l]. There are 13 
such other primitive relations feasible between 
two time intervals. 

Classical planning, based on situation calcu- 
lus, suffers from two shortcomings in their ap- 
plication in the real world. Firstly, it can not 
tackle a problem when two operations need to 
be performed at the same time to achieve an 
objective[3]. For example, to open a door one 
needs to turn door knob and push the door at 
the same time. This can not be easily repre- 
sented in conventional planning schemes. Even 
under the circumstances where such parallel op- 
erations are not essential, such plans may exe- 
cute faster (subject to the availability of suffi- 
cient resources for parallel execution of opera- 
tions). Secondly, any incompleteness of infor- 
mation about the real world can not be repre- 
sented in classical planning scheme. For exam- 
ple, one can make a phone call ‘before’ the class 
or ‘after’ the class, this flexibility of informa- 
tion can not be represented there. An interval 
based temporal reasoning scheme is capable of 
handling such situations. 

In the interval-based temporal reasoning 
scheme, each of the fluents and operations are 
considered as an interval in time. They lie on 
a unique non-branching time line, and so, each 
of them is temporally related to all the other 
ones. A single primitive relation as a temporal 
relation between a pair of temporal entities in- 
dicates definite information between those two 
temporal assertions, whereas a disjunctive set 
of primitive temporal relations indicates incom- 
plete information. In the next section, the 
scheme for interval based temporal reasoning 
will be discussed. 


II. Interval-based Temporal Reasoning 

Suppose the following set of information is 
given in the context of petroleum exploration. 
GS = gravity survey 
SS = seismic survey 
DA = drilling activity 
PA = production activity 
ER = enhanced recovery 

Apart from these operations there are following 
fluents which are affected by the operations. 1 
Surveys are done when there has not been any 
survey (NS) done on the area. Seismic survey 
produces subsurface geological knowledge(GK), 
it also produces huge noise(NO) caused by the 
artificial seismic explosions. Gravity survey can 
not be done during such noise. Drilling ac- 
tivity requires geological knowledge about the 
area, although it may make geological knowl- 
edge invalid. It also makes drilling wells avail- 
able(DW) which are required by production ac- 
tivity. Production activity produces data about 
the reservoir(RD) which is necessary for en- 
hanced recovery. Enhanced recovery is done 
for maximum production from a reservoir(MP). 
Actual temporal relations between them are 
given below. 

1. NS -{finished- by }-> GS 2 

2. NS ~{finished-by}-> SS 

3. SS -{equal}-> NO 

4. NO -{before, meet, after, met-by}-> GS 

5. SS -{overlap}-> GK 

6. GK -{during-inverse, finished-by, overlaps}- 

> DA 

7. DA -{starts}-> DW 

8. DW -{during-inverse, finished-by, 
overlaps}-> PA 

9. PA -{overlaps, statrs, equal}-> RD 

10. RD -{starts, equal, overlap, meet, before}- 

> ER 

11. ER -{meets}-> MP 


J The information given here about petroleum pro- 
duction is not necessarily realistic. Preconditions and 
postconditions are simplified to a great extent. 

2 For exact semantics of the 13 primitive temporal 
relations see[l]. 


Given these constraints, one may need to 
plan the activities for achieving maximum 
petroleum production from a reservoir, a state 
of MP, starting from a state of NS(no-srvey). 
For example, a trivial plan could be a serial or- 
dering of the operations GS, SS, DA, PA and 
then ER. 

Each of those operations or fluents is an in- 
terval in time. Some of the relations may not 
be consistent with respect to the others. A 
temporal reasoner’s primary job is to find out 
whether any consistent scenario is feasible or 
not, by propagating above constraints all over 
the temporal data base. In the context of plan- 
ning, this means whether there exists a plan or 
not. If there exists a temporally consistent sce- 
nario, or a plan , then finding one such instance 
would be the next task of a reasoner. Formaliz- 
ing planning problem as an interval constraint 
propagation problem, is being addressed to in 
[2]. According to this formalism each interval 
is represented as node in a constraint graph, 
and disjunctive temporal relations as labels on 
the arcs between these nodes. The temporal 
constraint graph (TCN) is a complete graph 
because every temporal interval (we call it as 
i-node) is related to the other t-nodes, even if 
there is no specific information about how they 
are related. This complete lack of information 
is represented as disjunction of all 13 primitive 
relations (termed as tautology). 

Any temporal constraint propagation algo- 
rithm systematically eliminates primitive rela- 
tions from the labels on arcs, which are incon- 
sistent. A global consistency algorithm 3 elimi- 
nates all such primitive relations which can not 
form a consistent scenario for the temporal as- 
sertions in the network. In such case, any prim- 
itive relation on any label can take part in at 
least one consistent scenario. Such a labelling is 
called minimal labelling. If during propagation 
any label gets all its primitive relations stripped 
off*, having a null relation, then it implies that 
the two end nodes can not have any consistent 

3 Global consistency algorithm checks for consistency 
of constraints all over the network, in contrast to a lo- 
cal consistent algorithm, which checks for consistency 
of every subnetworks of a fixed size. 


labelling between them. This in turn implies 
the given constraints were inconsistent with re- 
spect to each other, and any consistent tempo- 
ral scenario can not be formed. 

Interval-based temporal reasoning increases 
expressiveness of planning. But the main prob- 
lem with this scheme is that the problem of 
checking global consistency is NP-complete. 
There are approximate algorithms to address 
the problem and have inexact solutions[l, 10]. 
But generating a plan needs a temporally con- 
sistent model. Lack of this aspect was one of the 
weaknesses of the original work in this line by 
Allen et al [2] . In their scheme the arcs of the 
network will be left with consistent labelling, 
which is still a disjunctive set. Making a total 
order of the nodes is not feasible from such la- 
belling, which is demanded by a planning prob- 
lem. To manage the efficiency issue they have 
proposed a clustering approach. This would 
keep the network size under control so that run 
time of the algorithm is less affected by the in- 
crease in problem size. In this scheme all inter- 
vals should be clustered into a few groups based 
on some reference intervals, and propagation al- 
gorithm runs separately within each group. Al- 
though in some problem domains such hierar- 
chy of reference intervals may be inherent, in 
many domains, like planning, this approxima- 
tion may be impractical. 

III. Finding All Feasible Temporal 
Scenarios 

A global consistency algorithm finds out 
a globally consistent models or all consistent 
models as a side effect while trying to determine 
global consistency of a network. Any trivial 
backtrack algorithm can do this work in expo- 
nential time. It is important to devise heuristics 
to make it efficient. First heuristic based global 
consistency algorithm was proposed by Valdes- 
Perez[12]. There, the algorithm was not written 
well enough to be efficiently implemented. Re- 
cently Ladkin et al [6] and we [8] have come up 
with two different heuristic based algorithms for 
solving global consistency problem. 

Ladkin et al’s algorithm randomly picks up 
a singleton relation from an arc and runs an 


approximate algorithm to update relations on 
the other arcs while checking for consistency 
of the picked up primitive relation. If picked 
up relation is found to be inconsistent the al- 
gorithm backtracks over the set of disjunctive 
relations on the current and previously picked 
up arcs, otherwise it goes ahead with the next 
arc. The algorithm terminates if a singleton 
labelling is found for all arcs, generating a con- 
sistent model. It may also terminate by back- 
tracking up to the arc, which was picked up 
first, implying no consistent scenario is avail- 
able. Experimental results, presented by them, 
provides us with a confidence that the global 
consistency is a not a very difficult problem in 
average case, although its worst case behavior 
is NP-complete 4 . 

Table 1: Forward Pruning Algorithm 

For node number 1 to N do 

pickup an old singleton model of size (t — 1); 
for node number j— 1 to x — 1 do 

pickup singleton relation from label on 
arc < *, j > and update labels on all arcs 
from < t\j + 1 > to < t, * — 1 > with respect to 
this singleton and arcs in old network; 
if updation fails on some arc 

if there is any more singleton left on this arc 
pickup next singleton find proceed 
otherwise backtrack to previous fire; 
if backtrack exhausts up to the first arc 
if a model was found 

save it in data base of partial models 
(of size i); 

otherwise return failure; 
if arc < t, t — 1 > is readied force backtrack; 

The algorithm proposed by us [8] is based on 
a pruning heuristic where inconsistent relations 
are eliminated systematically. We call it for - 
ward pruning algorithm, because it prunes la- 
bels on all forward arcs in a preassigned order. 
A lose version of the algorithm is given in Ta- 
ble 1. There is reason to believe that such sys- 
tematic working should improve the efficiency. 
Another feature in this algorithm is that the 
nodes are also systematically picked up one by 

4 A very good example of such cases where a NP- 

complete problem is addressed comfortably in most in- 
stances, is the case of linear programming using simplex 
algorithm. 


one. At each stage of such addition of a node 
in the graph, a set of feasible models are gener- 
ated. Then the next node is attempted for addi- 
tion to each of these models. This model based 
approach makes it possible to generate all fea- 
sible consistent scenarios at a much lesser cost. 
In the worst case, the number of models itself 
may be exponentially growing with the num- 
ber of nodes. Some preliminary experimental 
results with this algorithm have shown that in 
reality this growth rate is not very high, and 
manageable. 

Efficiency of the forward pruning algorithm 
will also be aided with a fast preprocessing al- 
gorithm, which we have devised recently for in- 
cremental addition of nodes to temporal con- 
straint graph[9]. The incremental and model- 
based approach will also make a plan data base 
available, in which new operations can be added 
one by one. Then new plans can be generated 
with respect to these newly added operations, 
or any newly added information. Significance 
of having all feasible plans will be discussed in 
the next section. 

IV. Significance of Having All Feasible 
Plans 

Availability of all feasible plans allows one to 
have a choice of picking up the best plan accord- 
ing to some criteria. For example, in the previ- 
ously mentioned case of petroleum exploration, 
one can find out a plan whose execution will 
take lesser time than most other plans. This 
can be done by choosing a plan where maximum 
number of ‘overlap’ relations occur (for paral- 
lely executing those operations) 5 . This proce- 
dure can also be automated by assigning some 
order of priority on the primitive relations on 
each of the labels on arcs. The resulting mod- 
els, or plans, will then also be ordered by the 
system accordingly. 

Normally a planning activity involves reach- 
ing a preassigned goal state. Most of the cur- 
rent planning systems are based on this objec- 
tive. A temporal reasoning-based planning sys- 

5 Thus, a good plan there, is SS after GS, SS over- 
lapping DA, DA overlapping PA and PA overlapping 
ER. 


tern, as described in this article, need not be 
goal driven only. Using a global consistency 
algorithm one can generate all possible scenar- 
ios, which allows one to do temporal projection. 
Then one can choose appropriate goal state and 
a corresponding plan, from those future scenar- 
ios. Thus, planning becomes a subproblem of 
temporal projection problem[7]. As far as we 
know the implication of this is yet to be stud- 
ied. 

In a dynamic situation where an agent is ex- 
ecuting a plan unknown by another agent, if all 
feasible plans for the first agent are available, 
then the second agent can recognize the first 
one’s currently executing plan by observing its 
operations executed so far. The plan recogni- 
tion here becomes a problem of matching ac- 
tions executed in past, or a partial plan, with 
the plans in the plan data base, and finding out 
the possible candidate plan(s), which the first 
agent might be executing currently. 

There is a related problem of answering 
queries about plans. In our example, there may 
be a question whether seismic survey can be 
consistently done along with enhanced recovery 
under any plan. If the answer is ‘yes’, then the 
question would be what is the complete plan 
(or plans) under which that can be done. In 
the formalism described here, such questions 
can be answered using same pattern matching 
technique described in last paragraph, and it 
can also be done in real time, because of the 
availability of all plans. This may be an impor- 
tant advantage for an autonomous agent in any 
realistic environment. Isolating all possible sce- 
narios also make it easy for updating plan data 
base with new information, which is a matter 
of adding or dropping consistent models. 

In a time limited application, a time limit 
can be imposed when plans are generated, to 
create as many consistent plans as possible, 
rather than generating all plans. This will, of 
course, reduce some of the advantages discussed 
above. However, under some real life circum- 
stances, that may be a better solution than to 
fail to generate any plan because sufficient time 
was not allocated. 


V. Conclusion 

In this article we have discussed the feasi- 
bility of planning using interval-based tempo- 
ral reasoning scheme. An advantage of using 
temporal representation is that of incorporating 
uncertainty of information about the temporal 
relation between different temporal entities in 
the domain. There can be many plans feasible 
under this circumstances. Additional advan- 
tage of interval based representation is of higher 
expressiveness, which will enable new types of 
planning not attempted before. The problem 
of interval based reasoning is that of its hard- 
ness. We have devised an efficient algorithm 
which can find out all feasible scenarios under 
incomplete information, in most of the circum- 
stances. The implication of having all feasible 
plans available is multifold. They are also dis- 
cussed here. So far nobody has taken any look 
into these aspects, although practicable algo- 
rithms for finding out consistent scenario is re- 
cently coming into fore. 
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